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The minimum mean-square error (M.M.S.E.) at the receiver output 
generally depends upon the sampling instant and demodulating carrier 
phase for synchronous data systems. In this study, it is shown that 
for certain single-sideband data systems with no excess bandwidth 
(e.g., class IV and class V partial-response systems), the M.M.S.E. 
is completely independent of the sampling instant and demodulating 
carrier phase if the receiver contains an infinitely long transversal 
filter equalizer. Practically speaking, computer calculations indicate 
that for a class IV system operating in the presence of typical received 
signal-to-noise ratios, a 19-tap equalizer is sufficient to make the 
M.M.S.E. relatively insensitive to the sampling instant and demodidat- 
ing carrier phase. Thus, for such data systems, a significant reduction 
in the receiver complexity and possibly in the start-up time may be 
obtained, because no time is spent acquiring timing and carrier phase. 

The optimum infinite-length equalizer for synchronous data sys- 
tems with a fixed channel is also calculated for two different con- 
ditions. The conditions are: (i) the minimization of the output noise 
plus mean-square intersymbol interference and (ii) the minimization 
of the output noise subject to the constraint that the equalizer forces 
the intersymbol interference to zero. Explicit expressions for the 
optimum equalizer and the M.M.S.E. are obtained. Satisfying condi- 
tion (i) results in the lower value of M.M.S.E.; however, the M.M.S.E. s 
for these two criteria are almost equivalent for either large signal- 
to-noise ratios or small slope of the amplitude-frequency characteris- 
tics of the channel. 

I. INTRODUCTION 

In synchronous data systems, the transmission rates are frequently 
limited by the intersymbol interference which is caused by the ampli- 
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tude and phase distortion in the transmission channel. In order to 
reduce the effect of the intersymbol interference, it is necessary to 
equalize the channel before the data can be transmitted. 

Several automatic equalization schemes using transversal filters 
have been devised for such data systems. 1-6 Chang 8 has investigated 
the effect of the sampling instant and carrier phase on the minimum 
mean-square intersymbol interference for a noiseless system with a 
finite-length transversal equalizer. In principle, we can make the 
mean-square intersymbol interference arbitrarily small by using an 
infinitely long transversal filter, provided that the tap-gain settings 
can be made arbitrarily accurate. However, the equalizer which forces 
the intersymbol interference to zero may not be the most desirable one 
when noise is present. 

We have found, in this study, the optimum infinite-length mean- 
square equalizer for such synchronous data systems with a fixed 
channel. Two different cases are considered corresponding to the fol- 
lowing optimality criteria: (?') the minimization of the output noise 
plus mean-square intersymbol interference, and (ii) the minimization 
of the output noise power subject to the constraint that the equalizer 
forces the intersymbol interference to zero. 

Explicit expressions for the optimum equalizer and the M.M.S.E. 
are obtained. We also have found that for certain types of data sys- 
tems (S.S.B. class IV or class V partial-response systems) the 
M.M.S.E. does not depend upon sampling instant and demodulating 
carrier phase. Thus, for such data systems, it may be possible to 
reduce significantly the receiver complexity and the start-up time. 

A computer program has been written for a class IV system which 
is equipped with a finite-length mean-square equalizer. The number 
of taps needed to achieve near optimum performance in practical 
situations can then be determined. Throughout, additive Gaussian 
noise and independence of information digits are assumed. 

II. GENERAL CONSIDERATIONS 

The optimality criteria will be formulated in this section. A sim- 
plified block diagram of a general digital data system is shown in 
Fig. 1. We assume that every T seconds, an impulse of amplitude 
a n (a n = {2M + 1, • • • 1, -1, • • • -{2M + 1)}), is transmitted to 
the input of the system. The a.„ are assumed to be identically distrib- 
uted independent random variables. 

In the absence of channel noise, for a sequence of input impulses 
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Fig. 1— Digital data system, simplified block diagram. 

f; aj(t - nT), (1) 

n = — CO 

the corresponding sequence at the receiver equalizer output is 

*Zj n y{t-nT,6), (2) 

where y(t, 0) is the system impulse response with demodulating 

carrier phase 6* 

With noise, the output at the sampling instant t„ with a demodulat- 
ing carrier phase 8„ is 

(3a) 



V = a n >j(t lt , 9 ) + £ a n y(t n - nT, 6„) + n(U 



or 



V = a y,M + £ «»!I.M + 



n, 



(3b) 



where the terms ?/„(0„). n ¥* 0, represent intcrsymbol interference and 
2/o (0o) is the output value at the main sample point. 

One useful measure of the performance of such a data system is 
mean-square error (M.S.E.). In this study, we define the normalized 
M.S.E. at the sampling instant /„ with a demodulating carrier phase 
0„ to he 



[M.S.E.], 0i()o = E{[V - «oyo(^ 2 S/£K</o(0..)) 

= [E[n$] +E[a*] £ yl{B )VE{a 2 yl%)), 



(4) 



where E[X] means expectation of random variable X. 

For binary systems, £[a*] is equal to 1. The variance of the noise at 



*e = 0° corresponds to the phase of the frequency component of the received 
spectrum at the carrier frequency. 
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the equalizer output (see the Appendix) is 

al = E{nl) = & f " + eq («) ■ | £(») | 2 da>, (5) 

where o- 2 !r is the power spectral density of the input white noise, \f/ eq (w) 
is the square of the equivalent baseband receiver filter characteristic 
and -E(co) is the transfer function of the equalizer. 

Now we wish to design two optimum equalizers for two different 
conditions. In the first the [M.S.E. ],„,„„ is minimized subject to the 
constraint that y o (0a) is a constant, 

C, = yn(do) = Re - f Y eq («, 6 n )E(u)e ia '° do>, (6) 

where Y eq (w, () ) (see the Appendix) is the equivalent baseband 
system transfer function for sampling instant U and demodulating 
carrier phase 6 . In the second case the optimum equalizer is found by 
minimizing the variance of the output noise subject to the constraint 
equations, (6) and 

= y n (e ) = Re - f Y eq («, 6 )E{o>)e iaUa+nT) da, n * 0. (7) 

■K J„ 
III. MINIMIZATION OF NOISE PLUS INTERSYMBOL INTERFERENCE 

3.1 A General Binary Data System 

The details of the minimization of the [M.S.E. ],„<,„ given by equa- 
tion (4) subject to the constraint equation (6) are given in the Appendix. 

For a binary data system, the optimum equalizer, E tl {u>), for sampling 
instant t„ and demodulating carrier phase 6„ is 

{Feq(co, g Q V"°i* 



[#«(«)]«.... = 



[ofyeq(«) + I Yeq(o>, 0„) \'} 



t r_ 



Y eq (co, d ) 



(8) 



?^ eq («) + | F eq (w, O ) I 

where {X}'"' means complex conjugate of X. It follows that the 
M.M.S.E. for the corresponding sampling instant and demodulating 
carrier phase is 

[M.M.S.E .],.,,. 

-J " 1- (9) 

Y eq («, 6 ) | 2 do) 



T r' 

7T J„ 



<rW eq («) + | K eq («, O ) 
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| Y eq (a), do) | 2 is, in general, a function of t and O • It follows that 
[M.M.S.E. ],„,„„ depends generally upon t and 6 . Hence, there exists 
an optimum sampling instant l and demodulating carrier phase 6„ , 
such that 

[M.M.S.E.],-.,?. = min [M.M.S.E .],„.«„ . (10) 

all U,8o 

However, there exist cases where \Y eq (<■>, 0„)|- is not a function 
of t n and B» ; for example, the \Y eq («, 0„) | 2 of a single-sideband 
system with no excess bandwidth is independent of the sampling 
instant, t n , and the demodulating carrier phase, 0„ , (sec the Appendix.) 
The SSB class IV partial-response system represents another example. 
Therefore, if an infinite equalizer is available, no loss in performance 
occurs when arbitrary t„ and 0„ are used. 

3.2 SSB Class IV Partial-Response System 

In this section we will show that the M.M.S.E. for a class IV 
partial-response system is independent of sampling instant and 
demodulating carrier phase. The M.M.S.E. will be computed for 
certain typical telephone channels. Such a data system has been fully 
described in Reference 7. 

The transfer functions of the transmitter and receiver filters are 

S(a) c — o>) = R(u) r — w) 

V2T S m\u,\Te-" a/lu " rM < | » | S J, (u) 

otherwise. 

The M.S.E. for the partial-response system is defined to be 

Wl + (y l (e ) + ?m(0o)) 2 + E t >/M] 
[M.S.E.] C .,...„ = - [OM^^^Vr 111 ' (12) 

The constraint equations are 

C = yi (e Q ) = Re— [ " -i(sin aT)T(o> e - u>)e- ie 'E(u>)e iaU ° +T) dw 

(13) 
and 

C - 2 = y.M 

= Re— [" -j(sma>T)T(a r - co)e _ "'°£;(co)e"" J(7 '" 0> rfco (14) 

■K Jo 
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where Re [X] means real part of X, T(w) is the transfer function of 
the channel, and C is a constant. 

For a given constant C, sampling instant t„ , and demodulating 
carrier phase 0„ , the optimum equalizer is 
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(15) 
where [X]* means complex conjugate of X, and, Ai and A 2 are given 
by the equation (41a) and (41b) respectively. 
It follows that, the corresponding M.M.S.E. is 



[M.M.S.E.] C .«..«. 



IT J n 



[cr 2 2T sin coT + 4T 2 sin 2 coT- 1 T(co c - «) I 2 ] 



[Bo(«)] .,..i. | 2 rfco + 2C 2 - 4C. 



(16) 



Since | [i£o(co)]c, <„.<>» | 2 is independent of f and O , the M.M.S.E. 
does not depend upon t n and d n . Equation (16) can be further minimized 
over all possible values of C. The optimum solution, C = 1, results in the 
minimum of the M.S.E. for the class IV partial-response system equipped 
with a mean-square equalizer. 



[M.M.S.E.]c=i = 



— 9 



A, - A, 
= min [M.M.S.E.]c 



(17) 



We may thus conclude that for the SSB class IV partial-response sys- 
tem, the M.M.S.E. docs not depend upon t () and O since the constants 
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Ai do not depend on t and O ■ We may therefore arbitrarily choose 
the sampling instant and the demodulating carrier phase with no loss 
of optimality as long as the equalizer transversal filter length is 

infinite. 

As an example, we assume that the equivalent baseband channel 
characteristics are linear in amplitude-frequency response and 
quadratic in delay-frequency response as shown in Fig. 2. The 
delay at the Nyquist frequency of ir/T rad/s is taken to be p m T sec- 
onds. The transfer function of the channel is 



T(w c - w) = 1 1 - a 



*/T 



-HP„T'u>/3t') 



^ 



*¥ 



(18) 



The M.M.S.E.s computed by equation (17) for various a, /3 m T, and 
a\ are given in Table I. For these calculations the transmitted signal 
power is fixed at 4/tt watts. 

3.3 Computer Results for Class IV Partial- Response System with a 
Finite Length Equalizer 

A particular case has been calculated by the computer for a class IV 
partial-response system with a finite length equalizer. The following 
assumptions are made: 



DELAY 
IN SECONDS 



DELAY 



AMPLITUDE 




^r/T 



Fig. 2— Equivalent baseband channel characteristics. 
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Table I — M.M.S.E. Computed by Equation (17) 



<r,- 2 (10~ 2 watts/Hz) 



M.M.S.E. (10~ 2 ) 
a = 0.1, p m T = 1, T m 1 



M.M.S.E. (10- 2 ) 
a = 0.9, p m T = 1, T - 1 



4 

2 
0.4 
0.2 



5.621 
2.818 
0.564 
0.282 



22.57 

12.14 

2.74 

1.41 



(i) The transfer functions of the channel is 



r( „„ - a) = (i - o.i ig) 



,-l(B'/i B !"/3f») 



^ 



g tt/7 7 . (19) 



(ii) The signal-to-noise ratio at the receiver input is assumed to be 

21 dB. 
(Hi) The delay at the Nyquist frequency is taken to be 1 second and 
the baud is assumed to be 1 symbol/second. 

Forty distinct combinations of sampling instants (0, 0.2, 0.4, 0.6, 
0.8) and demodulating carrier phase (90°, 60°, 30°, 15°, 0°, -15°, 
— 30°, —60°) have been tried with a 19-tap mean-square equalizer. 
The results and the minimum of the mean-square error are shown in 
Figures 3 through 10. It can be seen that the M.S.E. for most combina- 
tions is near the minimum achieved by the infinite equalizer. Practically 
speaking, in this example the system performance is acceptable (with 
error-rate upper bounded 8 by 10~ 8 ) with a 19-tap mean-square equalizer 
for all 40 distinct combinations. 



IV. MINIMIZATION OF NOISE SUBJECT TO THE CONSTRAINT THAT THE 
EQUALIZER FORCES THE INTERSYMBOL INTERFERENCE TO ZERO 

4.1 A General Binary Data System 

The minimization of the output noise power [see equation (5)], 



2 
<T 



IT Jo 



\f/ eq (w) • | Efa) | 2 dw, 



subject to the constraint equations (6) and (7) can be solved through 
a straightforward application of the method of Lagrangian multipliers. 
The expression of the optimum equalizer for sampling instant t 
and demodulating carrier phase 6, t is found to be 



[£„(«)], 



Y eq («, O ) 



(20) 
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SAMPLING TIME 



0.8T 



Fi g . 3-M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem; baseband equivalent, channel transfer function, {1 -0.1 U"l{{ ,r /' ^ 
exp — ;'(u> 3 /3m T 3 /Zir-); demodulating carrier phase, = —60 , (&/iN)in P ut — 
21 dB. 

where R d {*>) i s the desired received baseband equivalent signal 
spectrum. 

It follows that the minimum output noise power is 



2m fT/T 

[min <ro]<„.«„ = -*— I $ ec l (»)Ci 

7T Jo 



Rd(«) 



do,. (21) 
F eq (w, O ) 

In general, Y eq (<o, ft>) is a function of the sampling instant, t , 

and the demodulating carrier phase, 6 n ; therefore the minimum output 

noise power depends upon t n and 0„ . 

4.2 Class IV Partial-Response System 

It can be seen from equation (21) that the M.M.S.E. generally 
depends upon t n and 0„ . However, for the SSB class IV partial- 
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Fig 4— M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem ; baseband equivalent channel transfer function, {1 — 0.1 }V*A/W T '*' 
exp — ;'(w 3 /3 m T 3 /3tt-); demodulating earner phase, = —30°, (S/N)i„ P u. — 
21 dB. 
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Fig. 5 — M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem; baseband equivalent channel transfer function, {1 — 0.1 [\u)\/(tt/T)]} 
exp — ;'(w 3 /3 m T 3 /3ir 2 ) ; demodulating carrier phase, = —15°, (S/N) input = 
21 dB. 



response system, 



Y eq (co, d ) 



T(u) c - ay) 



(22) 



Therefore, the minimum output noise power is independent of t and 

00- 

Table II shows the values of minimum output noise power computed 
by equations (21) and (22) for various a, fi m T, and &\ under the same 
assumptions made in Section III. For these calculations the transmitted 
signal power is fixed at 4/7r watts. 

Table III gives the difference in M.M.S.E. computed by equations 
(17) and (21). 
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0.8T 



Fig. 6 — M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem; baseband equivalent channel transfer function, {1 — 0.1 [|w|/(7r/T)]} 
exp — j(w 3 p m T 3 /3tt 2 ) ; demodulating carrier phase, 6 = 0°, (S/N) input = 
21 dB. 
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Fig. 7-M.M.S.E. versus sampling time; SSB class IV vaxtM-rempnaasya- 

tern; baseband equivalent, channel transfer function, {1 - 0.1 UfVW 1 }i J_ 

eX p — j(u 3 p m 7' 3 /3ir 2 ) ; demodulating earner phase. = lo . (b/JN;i*put — 
21 dB. 

The results show that the M.M.S.E.s computed by equations (17) 
and (21) are almost the same if either the signal-to-noise ratio is 
large or the slope of the amplitude-frequency characteristic of the 
channel is small (e.g., in this case the slope is 0.1). Notice that either 
decreasing the signal-to-noise ratio or increasing the slope of the 
amplitude-frequency characteristic of the channel increases the 
disparity of the M.M.S.E.s obtained by (17) and (21 ). As an example, 
if 



and 



&\ = 0.02 watts/Hz 



T(w r - «) = II - 0.9 



-i(»V8f') 



(23) 
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Fig. 8— M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem ; baseband equivalent, channel transfer function. {1 - 01 I MM*/' m 
exp — ;(« 3 /Jm rtyBw*); demodulating earner phase, B = 30 , (6/W).„ pl „ — 
21 dB. 
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Fig. 9 — M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem; baseband equivalent channel transfer function, {1 — 0.1 l\u\/(ir/T)]} 
exp — ;'(w 3 /3m T 3 /3w s ); demodulating carrier phase, = 60°, (S/N)i„ pu t = 
21 dB. 

then the M.M.S.E.s obtained by equations (17) and (21) are 0.1214 
and 0.1483 respectively. It can be seen that the M.M.S.E. is 16 percent 
less if the equation minimizing the mean-square intersymbol inter- 
ference plus noise is used. 

V. SUMMARY AND CONCLUSION 

The optimum equalizer for a synchronous data system with a fixed 
channel is derived in this study. Two different optimality criteria are 
assumed: (/) the minimization of the output noise plus mean-square 



0.010 . 



MMSE 
19-TAP MEAN-SQUARE 
EQUALIZER) 
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0.4T 
SAMPLING TIME 



Fig. 10 — M.M.S.E. versus sampling time; SSB class IV partial-response sys- 
tem; baseband equivalent channel transfer function, {1 — 0.1 [|w[/(tt/T)]} 
exp — ;(» s /9» T*/3r*); demodulating carrier phase, = 90°, (S/N),„ P ui = 
21 dB. 
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Table II— Minimum Output Noise Power Computed 
ry Equation (21) 



»,-» (10-* watte/Hz) 


<r °-(10- 2 ) 

a = O.l,0 m T = 1, T = 


= 1 


a 


-TO 2 (10- 2 ) 

= 0.9, m T = 1, r 


= 1 


4 
o 

I 
0.4 
0.2 


5.652 

2.S26 
1 .413 
0.. r )65 
0.282 


29.66 

14.83 

7.42 

2.97 

1 .49 



intersymbol interference and 07) the minimization of the output noise 
subject to the constraint that the equalizer forces the intersymbol 

interference to zero. 

Explicit expressions for the optimum equalizer and the correspond- 
ing M.M.S.E. are obtained. It is known that the M.M.S.E. at the 
equalizer output generally depends upon the sampling instant and the 
demodulating carrier phase. However, we have shown in this study 
that there exist cases where the M.M.S.E. is independent of the 
sampling instant and the demodulating carrier phase. The SSB class IV 
partial-response system represents a good example. Thus for such data 
systems, we may use arbitrary timing and carrier phase, thereby sig- 
nificantly reducing the receiver complexity and possibly the start-up 
time as well. The results calculated by the computer for an SSB 
class IV partial-response system equipped with a 19-tap mean-square 
equalizer show that the system error-rate for all 40 distinct combi- 
nations of sampling instants and carrier phases is less than 10"*. The 
system is operated over a channel with linearly distorted amplitude- 
frequency characteristic and parabolically distorted delay-frequency 
characteristic (see Section III ) which is worse than a worst-case C-2 
line. The signal-to-noise ratio at the receiver input is assumed to 
be 21 dB. The results also show that with either small slope of the 



Table III — Difference in M.M.S.E. 



<r,2 (10" 2 watts/tfz) 


<ro 2 - M.M.S.E. (10" 2 ) 
a = O.l.ft.T' = 1, T = 1 


ff0 2 - M.M.S.E. (lO" 2 ) 
a = 0.9, p m T = 1, T = 1 


4 

2 

1 
0.4 
0.2 


0.031 

.08 
0.002 

=0 

=0 


7. OS 
2.69 
0.97 
0.23 
0.08 



1684 THE BELL SYSTEM TECHNICAL JOURNAL, MAY-JUNE 1971 

amplitude-frequency characteristic of the channel or large signal-to- 
noise ratio, the M.M.S.E.s obtained by the two different criteria con- 
sidered in this study are almost the same. For example, with white- 
noise spectral density 0.02 watts/Hz (S/N at the receiver input is 
18 dB) and the Fourier transform of the channel 



i -o.i J -^K' (M,/a "\ 

the M.M.S.E.s obtained by criteria (i) and (ii) are 0.02818 and 0.02826 
respectively. However, either increasing the slope or decreasing the 
signal-to-noise ratio increases the disparity of the M.M.S.E.s obtained 
by criteria (i) and (ii) . Under these situations, criterion (i) is much 
preferred. For example, with the same white-noise spectral density as 
before and the Fourier transform of the channel 



(i-o.9^1)-<<-< 



the M.M.S.E.s obtained by criteria (i) and (ii) are 0.121 and 0.148 
respectively. 
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APPENDIX 

Minimization of A T oise Plus Intersymbol Interference (Binary and 
Partial-Response Systems) 

The details of the minimization procedure of noise-plus-intersymbol 
interference for the binary and partial-response systems will be given 
in this Appendix. 

The block diagram of a general digital data system is shown in 
Fig. 1 . The characteristics of the ideal low-pass filter and the equalizer 
are assumed to be 

, iM fi osm**. (24) 

lo otherwise 

and 

e( U ) = f; cj mt . 
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With input white Gaussian noise having one-side power spectral 
density TV 2 watts/Hz, the variance of the noise at the receiver equalizer 
output is, 

*l = E(n 2 ) 

= Tp. r ||B( w _„ e ) | 2 + | «(co c - a,) | 2 )*-|£(co) \ 2 dw 

= |^/" m tff*)\B(p)\ % d» 

= if\ E / m\E{u>)\ 2 d* 

ZlT \K=-N+1 J (r/T)(2K-l) 

/-(x/T)(+2iV+l) /*<■>-» ^ 

*(«) | E(u) \ 2 do>+ *(«) | #(«) | 2 dcof 

.„„ J(f/D(2-V-1) J 



m 2 «r/T 

= — L / ^ eq (w) • | £(w) | 2 die, 

7T Jo 



(25) 



where 



* eq (a>) = vV(«) + *(« + |r) +••• + *(« + V/ ' (26) 
(2AT - 1)tt . . (2JV + 1)tt 

y ^ «. ^ r * 

Similarly, 
y (* 0) = 1- P [S(o> - « e )T(« - co c )J?(co - <a c )e ie 

+ S(a t + w)r(«„ + w)B(«« + u )c~'"']E(«)c , ' u ' &o 
= £ f " F(w, d)E(u)e iut rfco 

27T J - Um 

= i- / F(«, 0)E(a)e imt do> 

'2lT \_J-Um 

tt-\ r (r/T){2K+l) 

+ £ / F(w, d)E(a,)e iut du 

A'«-A' + l «Mir/r)(2K-l) 

+ P F(«, d)E(o>)e iut du 

Jir/Ti2N-l) J 

= Re - (" F eq («, B)E(u)e iat du, 

7T Jo 



(27) 



*R(u) is the receiver filter transfer function. 
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where 

F eq (*, 6) = Y(u>, d) + y(u + ^ , o) + ■ ■ • 

+ 7( w + 2^,,). (28) 
By Parseval's theorem we can write 

S ?/n(0) = - f' ^ | Y eq («, 0) | 2 • | E{u) | 2 du>. (29) 

n T Jo 

Therefore the normalized M.M.S.E. given by equation (4) can be 
rewritten as 



nr/' *«!(«)• i w i 2 dw + 5] 



[M.S.E.] (o . 9o = -^-^^ -^- * (30a) 

where 

B = £ f" T | Y eq («, O ) M ^(«) f ^ - A*)' (30b) 

7T J 

Since ?/o(0o) is fixed, minimizing [M.S. E. ],„,,»„ subject to the constraint 
equation (6) is equivalent to minimizing the following function, 

V = - f" T tff eq («) + | Y eq («, d ) \ 2 ] ■ \ E(f>) | 2 da>, (31) 

T J 

subject to the same constraint equation. 

The minimization problem can be solved through a straightforward 
application of the method of Lagrangian multipliers. 

Solving 

m - sfefajFJT" {[ ^ eq(w) + ' 7eq(w ' " o) n ' m<o) r 

+ XF eq (o>, d )E(a))e iu, °} tfo>| = 0, (32) 
and 

C, - Re - / F eq («, e )E(w)e iuto dw, (33) 

7T Jo 

we obtain the expression for the optimum equalizer, EoM, at the 
sampling instant, t , and the demodulating carrier phase, O , 
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l/*o(«)],.... - |^eq(«)+ | Feq(«, O ) 



7T Jo 



F eqjto, O ) 



(34) 



da) 



erfy eq (o») + | Y eq (o>, 0„) | 2 

where {X)* means complex conjugate of X. Substituting [E (u>)] lo ,e 
into equation (4), we obtain the M.M.S.E. 

[M.M.S.E/L.o. 

1 



t. r 

IT Jo 



Y eq (to, O ) 



- 1. 



(35) 



<r?^ eq (to) + | F eq (to, O ) I 

Equation (35) can be further minimized over all possible sampling 
instants and carrier phases to obtain a global minimum of mean square 
error. 

We now consider the class IV partial-response system. The transfer 
function of the equivalent baseband transmitted signal and receiver 
filter are 



S(u) c — 0)) = R((t) c — to) 

r 



V2Tsin | co |r e -'< u/u " )T/4 ^ | to \ i 
[0 otherwise. 



■K 

T (36) 



It follows that 
F eq (to, 0) = \ 



2Tsmo>Te- H * /2+e)unul -T(o> c - u) £ | « | £ £;, 







otherwise. 



The constraint equations are assumed to be 



C = yM = Re 



7T J 



Feq(to, o )-E(fi>)-e ia<T + , ' ) du, 



(37) 
(38a) 



and 



C - 2 = y^(d ) 



= Re 

where C is a constant. 



IT J 



F eq (to, 0o)-^)-e"'" (r "' o> du, (38b) 
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We now wish to minimize the function 



U = Re- P {[>?2r |sina>!T| 



+ 4T 2 | sin wIT | 8 - 1 T(co c - a.) | 2 ] • | E(a) | 2 

+ X 1 Feq(co, e )E(a)(? mlT+t ' ) 

+ X 2 Y eq (co, 0o)£(u)e~'''' ,(r ~' o) } rfco (39) 

subject to the constraint equations (38a) and (38b). The expression 
for the optimum equalizer for a given constant C, sampling instant t , 
and carrier phases O is 



[E (o})] Ci to,Bo = 



C(A 


A\ 


A 2 ) + 2A 2 
- A\ 


+ 


eq(co 


W 


w(T+lo 


}* 


C(A X 


A\ 


A 2 ) - 2A, 
- Al 


[Y 


eq(co, 


B Q )e~ 


inir-i 


.),* 



c r 2T | sin coT | + 4T 2 sin 2 co7 7 - 1 T(a e - co) |' 



0£|co|^ 



(40) 



where 



and 



a t, 1 f' /T 2Tsmo>T-\T(u> c -co) I 2 , , A1 . 

Ai = Re ; I . 2 + 2TsincoT-|T(co c -L)| 2 ^ (41a) 



, t, 1 r T/r 2TsincoT-|!r(^ - «) l 2 -e'" 2r , „ 1U , 

A 2 = Re - / 2 ■ 07 , •' i, | w n 5 dta - ( 41b ) 

t Jo c, -f- 21 sin coi • | 1 (co c — co) | 

It follows that the M.M.S.E. is 

[M.M.S.E.] C .«.... 

= - f" [cr 2 2T I sin coT | + 4T 2 I sin a>T I 2 - 1 7\co c - co) I 2 ] 

7T J 

• | [#o(<o)]c. < .». T <*co + 2C 2 - 4C. (42) 

Since | Y eq (co, O ) | 2 is independent of f and 6 , hence | [E (u)] c .t .e a | 2 
and [M.M.S.E. ]c, <0 ,9 do not depend upon t and O . 
Equation (42) can be further minimized with respect to C by solving 
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^[M.M.S.E.]c....o. = 0. (43) 

The optimum solution C = 1, provides the M.M.S.E. for a class IV 
partial-response system. 



_ 2 

'2 



[M.M.S.E.]- - TT=~A: 

= min [M.M.S.E.]c . (44) 

all r 

In the absence of channel noise, tr t = 0, then 

.4, = 1, (45) 

and 

A a = 0. (46) 

Hence, 

[M.M.S.E.] C -, = 0. (47) 

REFERENCES 

1 Luckv R W., "Automatic Equalization for Digital Communication," B.S.T.J., 

U, No. 4 (April 1965), pp. 547-588. 

2 Luckv R W "Techniques for Adaptive Equalization of Digital Communica- 

tion." B.S.T.J.. 45, No. 2 (February 1966), pp. 255-286. 

3 Luckv, R. W., and Rudin. H. R., "An Automatic Equalizer for General Pur- 
' pose Communication Channels." B.S.T.J #, No. 9 (November 1967), pp. 

9 1 7Q— 2208 

4 DiToro M J.. "A New Method of High-Speed Adaptive Serial Communica- 

tion Through Anv Time-Variable and Dispersive Transmission Medium. 
Conf Record. 1965 IEEE Annual Commun. Conv., pp. 763-767. 

5 Coll D D. and George, D. A., "The Reception of Time-Dispersed Pulses, 

Conf Record. 1965 IEEE Ann. Commun. Conv., pp. 749-752. 

6 Chang R W., "Joint Optimization of Automatic Equalization and Carrier 

Acquisition for Digital Communication." B.S.T.J., 40, No. 6 (July-August 
1970). pp. 1069-1104. . 

7 Kretzmer E. R., Generalization of a Technique for Binary Data Communica- 

tion, IEEE Trans, on Commun. Tech., COM-14, No. 1 (February 1966), 

pp. 67-68. . .. .. 

8 Saltzberg B R , "Intersvmbol Interference Error Bounds with Application to 

Ideal Bandlimited Signaling," IEEE Trans. Information Theory, IT-14, 
No. 4 (Julv 1968), pp. 563-568. 



